AUTOMATED TOOLS FOR SUBJECT MATTER EXPERT EVALUATION OF AUTOMATED SCORING
نویسندگان
چکیده
منابع مشابه
Automated Tools for Subject Matter Expert Evaluation of Automated Scoring
As automated scoring of complex constructed-response examinations reaches operational status, the process of evaluating the quality of resultant scores, particularly in contrast to scores of expert human graders, becomes as complex as the data itself. Using a vignette from the Architectural Registration Examination (ARE), this paper explores the potential utility of classification and regressio...
متن کاملCost Function Modelling for Semi-automated SC, RTG and Automated and Semi-automated RMG Container Yard Operating Systems
This study analyses the concept of cost functions for semi-automated Straddle Carrier (SC), Rubber Tyred Gantry (RTG) and automated Rail Mounted Gantry (RMG) container yard operating cranes. It develops a generic cost based model for a pair-wise comparison, analysis and evaluation of economic efficiency and effectiveness of container yard equipment to be used for decision-making by terminal pla...
متن کاملExperimental Evaluation of Subject Matter Expert-oriented Knowledge Base Authoring Tools
We describe a large-scale experiment in which non-artificial intelligence subject matter experts (SMEs)—with neither artificial intelligence background nor extensive training in the task—author knowledge bases (KBs) following a challenge problem specification with a strong question-answering component. As a reference for comparison, professional knowledge engineers (KEs) author KBs following th...
متن کاملAutomated Essay Scoring for Swedish
We present the first system developed for automated grading of high school essays written in Swedish. The system uses standard text quality indicators and is able to compare vocabulary and grammar to large reference corpora of blog posts and newspaper articles. The system is evaluated on a corpus of 1 702 essays, each graded independently by the student’s own teacher and also in a blind re-grad...
متن کاملTools for automated legislative
We describe a method for automated codiication of regulations that is being developed at the University of Amsterdam. The method is based on the distinction between normative knowledge and world knowledge (cf. (Breuker & den Haan 1991)). The world knowledge is used to generate all possible situations, which are in turn divided over a subset of legal situations and illegal situations. This bipar...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ETS Research Report Series
سال: 2004
ISSN: 2330-8516
DOI: 10.1002/j.2333-8504.2004.tb01941.x